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1.0  INTRODUCTION 


Ergodicity  is  the  condition  which  enables  time-averaged  statistics  of  random 
processes  to  approximate  those  obtained  by  ensemble  averages.  This  condition  is 
often  assumed  in  estimation  and  other  signal  processing  problems  since  a  single 
realization  consisting  of  a  window  of  time  samples  is  most  often  available  in 
practice.  However,  the  dependence  of  the  ergodic  behavior  of  random  processes 
upon  fundamental  process  characteristics  such  as  its  correlation  and  statistics  as 
well  as  the  resulting  implications  on  estimation  performance  evaluation  is  not  often 
considered.  For  example,  the  covariance  estimate  performed  over  multiple  range 
cells  in  an  airborne  radar  application  in  which  the  ground  clutter  is  non- 
homogeneous  will  exhibit  non-ergodic  behavior.  In  this  case,  estimates  obtained 
by  averaging  time  samples  of  the  data  within  a  given  range  cell  will  not  be 
equivalent  to  those  obtained  by  averaging  over  range  cells. 

For  the  class  of  non-Gaussian  processes  known  as  spherically  invariant 
random  processes  (SIRP's),  the  ergodic  property  does  not  hold;  i.e.,  the  estimates 
obtained  from  time-averages  are  not  equivalent  to  those  obtained  from  ensemble 
averages.  SIRP's  are  generalizations  of  the  Gaussian  random  process  in  that  the 
PDF  of  every  random  vector  obtained  by  sampling  a  SIRP  is  uniquely  determined 
by  the  specification  of  a  mean  vector,  a  covariance  matrix  and  a  characteristic  first 
order  PDF.  In  addition,  the  PDF  of  a  random  vector  obtained  by  sampling  an  SIRP 
is  a  monotonically  decreasing  function  of  a  non-negative  quadratic  form. 
However,  the  PDF  does  not  necessarily  involve  an  exponential  dependence  on  the 
quadratic  form,  as  in  the  Gaussian  case.  We  also  note  that  many  of  the  attractive 
properties  of  the  Gaussian  random  process  also  apply  to  the  SIRP's.  Finally,  in  the 
above  example  of  the  airborne  radar,  the  SIRP's  have  been  noted  to  model  the 
statistics  of  the  gound  clutter  interference  [5]. 

The  ergodicity  condition  for  the  biased,  time-averaged  correlation  function 
estimator  expressed  in  terms  of  the  process  correlation  and  statistics  (non-Gaussian 
as  well  as  Gaussian)  is  derived  in  this  paper.  Specifically,  analytic  expressions  are 
developed  for  the  variance  and  bias  of  a  time-averaged  correlation  function 
estimator  for  stationary  discrete  complex  spherically  invariant  random  processes 
(SIRP's)  [1].  If  the  variance  of  the  estimator  approaches  zero  in  the  limit  of 
infinitely  large  sample  sizes,  the  ergodic  condition  holds.  However,  for  SIRP's,  it 
is  shown  that  this  condition  does  not  hold.  The  analytic  expressions  derived  here 
provide  insight  regarding  both  the  correlation  and  statistical  parameters  which 


control  the  ergodic  dependence.  Furthermore,  they  are  shown  to  reduce  to  the 
expressions  applicable  to  Gaussian  processes  as  a  special  case.  The  development 
also  pertains  to  the  general  class  of  SIRP  processes  with  unconstrained  quadrature 
components  (i.e.,  for  processes  with  elliptical  symmetry)  where  the  bandpass 
processes  are,  in  general,  non-stationary  [2,3].  For  the  special  case  of  complex 
processes  with  constrained  correlation  between  the  quadrature  components  (i.e., 
circular  symmetry),  the  resulting  analytic  expressions  attain  a  simplified  form. 
Validity  of  the  analytic  expressions  is  presented  using  Monte-Carlo  simulations. 
The  affect  of  the  estimator  performance  when  used  in  a  detection  scheme  designed 
for  SIRP's  is  reported  in  [4]. 


2.0  NON-GAUSSIAN  PROCESS  DEFINITION 


In  this  section,  we  discuss  the  class  of  non-Gaussian  random  processes 
known  as  Spherically  Invariant  Random  Processes  (SIRP's)  [1,5].  Following 
Rangaswamy  [5],  we  first  define  a  spherically  invariant  random  vector  (SIRV)  as  a 
random  vector  (real  or  complex)  whose  PDF  is  uniquely  determined  by  the 
specification  of  a  mean  vector,  a  covariance  matrix  and  a  characteristic  first  order 
PDF.  A  spherically  invariant  random  process  (SIRP)  is  a  random  process  (real  or 
complex)  such  that  every  random  vector  obtained  by  sampling  this  process  is  an 
SIRV.  An  important  theorem  in  the  theory  of  such  processes  is  the  representation 
theorem  [Ij  stated  as  follows. 

Theorem  1.  If  a  random  vector  is  an  SIRV,  then  there  exists  a  non-negative 
random  variable  S  such  that  the  PDF  of  the  random  vector  conditioned  on  S  is  a 
multivariate  Gaussian  PDF. 

For  an  SIRV,  we  consider  the  product 


yijNj  =  sxi  N 


(2.1) 


where  Xjjsf  =  [yi  yz  —  denotes  the  SIRV,  =  [xj  X2  ...  Xj^]^  is  a  Gaussian 

random  vector  with  zero  mean  and  covariance  matrix  E  and  s  is  a  real,  non¬ 
negative  random  variable  with  characteristic  PDF  fs(s).  Statistical  independence 
between  Xijsj  and  s  is  assumed  for  convenience.  In  [5],  several  characterisic  PDFs 
for  fs(s)  are  considered  which  provide  various  PDFs  for  fy(y).  Among  others,  they 

include  the  Chi,  Weibull,  Generalized  Rayleigh,  Rician,  the  K-distribution, 
Laplace,  Cauchy,  Student-t  and,  as  a  special  case,  the  Gaussian. 

In  section  3,  we  consider  K-distributed  processes  using  a  form  of  the 
Gamma  distribution  for  fs(s).  For  processes  consisting  of  in-phase  (real)  and 

quadrature  (imaginary)  components,  the  K-distributed  envelope  PDF  is  expressed 
as 


= 


2Va 

r(a) 


be 


2  J 


(0  <  r  <  oo) 


(2.2) 


where  r(a)  is  the  Eulerian  Gamma  function,  K„(-)  is  the  modified  Bessel  function 
of  the  second  kind  with  order  a.  Here,  a  is  refered  to  as  the  shape  parameter. 
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3.0  VARIANCE  OF  THE  TIME-AVERAGED  AUTOCORRELATION 
FUNCTION 


The  ensemble  autocorrelation  function  is  defined  as  the  expectation  of 
lagged  products  of  a  given  stationary  process  when  averaged  over  an  ensemble  of 
realizations.  If  this  function  is  equal  to  the  time-averaged  autocorrelation  function 
obtained  from  a  single  realization,  the  process  is  called  autocorrelation  ergodic. 
Consider  the  time-averaged  estimate  of  the  autocorrelation  function  using  Nj 

temporal  observation  samplesof  the  i*  channel  process  yj(n)  [6] 


Nj-l-l 

iJi  Zyi(n)yiVi) 


n=0 


1  N,-ll|-l 

M  Syi(«)yi(^*"i) 


0<I<N.j.-l 


-(N.j.-l)<l<0. 


(3.1) 


For  M  =  Np,  we  obtain  the  biased  estimator  ftyCl.N-p)  while  for  M=Nj-l,  we 

have  the  unbiased  estimator.  In  this  paper,  we  consider  the  biased  correlation 
function  estimator  with  limited  data  since  it  ensures  positive  semi-definiteness. 
The  derivation  for  the  unbiased  estimator  follows  directly.  A  similar  derivation 
also  holds  for  the  cross-correlation  function  using  relations  developed  in  [3].  We 
now  define 


<l)(n,l)  =  yi(n)y*(n  - 1) 


R^(k,l)  =  E((|)(n,l)(t)*(n  -  k,l)] 

SO  that 

C^(k,l)  =  E[{(l)(n,l)  -  E[({)(n,l)]}  {(|)*(n-k,l)  -  El(|)*(n-k,l)] }  ] 
=  R^(k,l)  -  E[(l)(n,l)]E[(})*(n-k,l)]. 


(3.2a) 

(3.2b) 

(3.2c) 

(3.2d) 
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Using  eq(3.1),  the  mean  RyCl.N^-)  and  variance  Vy(l,Nj)  of  fey(l,Nj)  can  now  be 
expressed  as 

I  Ry(l)  0<l<N^-i 
^  n=0 

M  nil 

i;r  I  Ry(i)  -(Nt-i)<i<o. 

^  n=0 

where  Ry(l)  =  E[yj(n)yi  (n  - 1)]  and 
Vy(l,NT)  = 


=  e{  [fty(l,NT)  -  E(fty(l,NT)  ]][ft^(I.NT)  -  E[ft^(l,NT)} 

=  E(fty(I.NT)fty(l,NT)]  -  E[fey(l,NT))E(fty(l,NT)] 

■,1  E  [.-ric...#. 

Tk=.(N^-ll|-l)L 

(3.4a) 

(3.4b) 

(3.4c) 

Expanding  eq(3.3),  we  have 

f  Ry(l)-fj^Ry(l)  0<I<NV-1 

E[fey^^(I.N^)]=<^  / 

Ry(l)-j^Ry(l)  -(t^-l)<l<0. 

(3.5) 

We  note  that  the  second  term  on  the  right  hand  side  of  eq(3.5)  denotes  the  bias  of 
the  estimate.  Thus,  the  magnitude  of  the  bias  IBI  is  expressed  as 

IBI=  III  IRy(l)l/NT. 

(3.6) 

From  eq(3.2a) 

E[(l)(n,l)]  =  Ry(l) 

(3.7a) 
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and 


E[(j>*(n-k,l)]  =  R^(l) 


(3.7b) 


so  that  from  eq(3.2d) 

C^(k,l)  =  R^(k.l)  -  lRy(l)|2 


(3.8) 


And  so,  eq(3.4c)  becomes 


Vy(I.NT)  =  N-  I 

k=-(N_-ll|-l) 


(3.9) 


We  first  consider  R^(k,l)  in  eq(3.9).  Using  eq(3.2a),  we  have 


R«,(k,l)  =  E[(Kn,l)<|)*(n  -  k,l)l 

=  E[yi(n)y*(n  -  l)y*(n  -  k)yi(n  - 1  -  k)]. 


(3.10a) 

(3.10b) 


From  the  representation  theorem  described  in  section  2,  ^(n)  =  sXj(n)  where 
s  is  a  real,  non-negative  random  variable.  Since  s  is  statistically  independent  of 
Xj(n),  eq(3.10b)  can  be  expressed  as 

R<!m,(kJ)  =  E[s^]E[Xi(n)x*(n  -  l)xi(n  -  k)Xj(n  - 1  -  k)].  (3.1 1) 

The  second  expectation  contains  zero-mean,  jointly  stationary  Gaussian 
quadrature  components  Xjj(n)  and  xjQ(n).  It  can  therefore  be  expressed  as  [see 

Appendix  B] 


E[Xj(n)Xi (n  -  Oxj (n  -  k)xj(n  - 1  -  k)]  =  1Rx(I)I^  +  lRx(h)l^  +  Fjj..(l,k) 


(3.12) 


where 


Rx(l)  -  E[Xi(n)Xi  (n  - 1)] 
and 


(3.13a) 
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F,..(l,k)  =  {Rx(l+k)  -  R?S(|+k)}  {R"(l-k)  -  R?^l-k)) 

+  { R?’(l+k)  +  R‘‘^(l+k))  { R?'(l-k)  +  R|P(l-k) ) 

-  j  { R"(l+k)  -  R?*(l+k) )  { R?'(l-k)  +  R|[‘^(l-k)  1 
+  j  {  R"(l-k)  -  R?^(l-k) )  { R?’(l+k)  +  RjPd+k) ) .  (3. 1 3b) 


And  so,  eq(3.1 1)  becomes 


R,4(k.l)  =  E[s'']  { |R^(I)P  +  lR*(k)|2  +  F^..(IJc) ) 
Next,  we  consider  the  term  IRv(I)I^  in  eq(3.6).  Since 


(3.14) 


then 


Ry(l)  =  Efvj(n)y*(n  - 1)]  =  E[s2]R^(l), 


lRy(l)P  =  E2[s2]IRx(I)P. 


(3.15) 

(3.16) 


Using  eqs(3.14)  and  (3.16)  in  (3.9),  we  have 


Vyd-Nx)  =  NI  I 

k=-(N^-ll|-l) 


-E2[s2]lR^d)p}  (3.17) 


where  the  real  part  of  Fx..(l4^)  results  due  to  the  cancellation  of  the  imaginary  terms 

in  eq(3.13b)  when  the  summation  over  positive  and  negative  values  of  k  is  taken. 
For  circular  Gaussian  processes,  Rx\0  =  R^(l)  and  RiP(l)  =  -  Rx  VO.  so  that  from 
eq(3.13b)  Fx..(!,k)  =  0  for  all  l,k.  In  this  case,  eq(3.17)  can  be  written  as 


Vy(l,NT)  = 

Nt-II|-1 

=  Fr  E  fl-%r|{E[s‘']lRxWl^+[E[s'']-E^[s^l]lM)lU-  (318) 
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Since  R^CI)  does  not  depend  on  k,  the  summation  over  the  second  term  in  the  {  } 
bracket  results  in 


1  ^  I  11^  I  {E[s4]-E2[s2]}IR^(I)|2  }  =  {E[s4]-E2[s2]}IR^(I)P. 

(3.19) 

Thus,  eq(3.18)  becomes 
Vy(l,NT)  = 

=  jr  1  1-%®^  {e(s‘'11R#)P  }+{E[s'']-EW)IR^(I)F  (3.20) 

^  k=-(N^-ll|-lj-  ^  J 

Eq(3.20)  is  the  significant  contribution  of  this  paper.  It  describes  the 
variance  of  the  time-averaged  correlation  function  estimator  for  SIRP’s.  What  is 
most  significant  is  the  fact  that  the  second  term  on  the  RHS  of  eq(3.20)  is  not 
dependent  upon  N^;  i.e.,  as  the  time  window  sample  size  Nj  increases,  this  term 
does  not  provide  a  decrease  in  VyCl.N^). 

We  now  introduce  the  error  variance  EVy(l,Nj)  defined  as 

EVy(l,NT)  = 

=  E  { [fty(l,NT)  -  Ry(I.NT)  ]]  [ft^(l,NT)  -  R^(I,Nt)  }  (3.21 ) 

From  eq(3.6),  the  magnitude  of  the  bias  B  can  be  expressed  as 

IBI  =  ^Ry(l)l=  ^E[s2]IRj(I)I  (3.22) 

and  recognizing  that  the  error  variance  EVy(l,Nj)  can  be  written  as 

EVy(l,NT)  =  Vy(l,NT)  +  IB|2  (3.23) 

we  have 
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EVy(l,NT)  = 


Ny-ll|-l 


k=-(Ny-ll|-l> 


{E[s<]lR,(k)P  }+{E[s‘']-E2[s2])lRj(l)P 


IIP 

+  -2E2[s2]IR,(I)P 

N'T 


(3.24) 


For  the  special  case  of  K-distributed  processes  with  shape  parameter  a  and 
scale  parameter  b,  it  can  be  shown  [see  Appendix  C]  that  E[s'*]  =  (a)(a+l)/b^  and 
E[s2]  =  a/h?.  We  can  let  E[s2]  =  1  without  loss  of  generality.  And  so,  for  b= 
eq(3.20)  becomes 


1 


N.J.-III-1 


V  (I,Nt)  =  it  I 

^  k=-(N^-ll|-I) 


1 


-  +  ^Rx(l)P  (3-25) 


For  Gaussian  processes,  a->oo  and  eq(3.25)  reduces  to  eq(5.2.8)  of  [3];  i.e., 

N.J.-III-1 

Vy(l,NT)=5r  S  (3.26) 

^  k=-(Ny-ll|-l) 

We  note  that  the  term  (l/a)lRx(l)r  in  eq(3.25)  becomes  the  dominant  term 

as  a  is  reduced;  i.e.,  as  the  processes  tend  toward  non-Gaussian  with  high  tails. 
This  term  also  introduces  a  stronger  dependence  of  the  variance  upon  the  lag  value 
than  the  corresponding  Gaussian  case  expressed  in  eq(3.26).  This  result  is  also  tme 
for  the  error  variance  expressed  in  eq(3.24).  What  is  most  significant,  however,  is 
the  fact  that  this  latter  term  is  not  dependent  upon  N^;  i.e.,  as  the  time  window 
sample  size  Nj.  increases,  this  term  does  not  provide  a  decrease  in  Vy(l,Nj).  This 

is  an  indication  of  the  fact  that  the  SIRP  processes  are  non-ergodic.  In  this  case, 
Vy(l,NT)  does  not  tend  toward  zero  as  Nj  approaches  infinity.  In  section  4,  we 

present  results  which  illustrate  the  significance  of  this  result. 
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4.0  RESULTS 


In  this  chapter,  we  validate  the  analytic  expressions  developed  in  section  3 
using  Monte-Carlo  simulation.  K-distributed  processes  with  an  exponentially 
shaped  correlation  function  are  generated  via  a  first  order  autoregressive  AR(1) 
process.  In  this  case  the  white  noise  driving  term  is  K-distributed.  In  each  case. 
Nr  realizations  of  the  random  process  yj(n)  are  generated  with  Nj  time  samples  per 

realization.  The  time-average  estimator  is  used  on  each  n#**  realization  to  compute 
Ry(l,Nj|m).  The  sample  variance  of  these  estimates  are  then  computed  over  the  Nr 

realizations  using  the  expressions  derived  in  the  next  subsection.  For  Nr  large, 
these  values  are  compared  to  those  obtained  via  the  ensemble  averaged  expressions 
in  the  previous  chapter. 

4.1  Computed  Variance  of  the  Time- Averaged  Correlation  Functions 

Consider  Nr  realizations  of  the  random  process  y{(n).  Let  each  realization 
be  indexed  by  the  integer  m;  m=l,2,...,NR.  Corresponding  to  the  realization  with 

index  m,  let  fty(l,Nj|m)  be  the  biased,  time-averaged  cross-correlation  function 
estimate  using  Np  observation  samples.  The  sample  variance  of  the  time-averaged 
cross-correlation  function  estimate  is  computed  from  Nr  realizations  using  the 

expression 


Nr 

Var[ftj,(l,NT):NR]  =  J  I  6y(l,NT|m)  -  fty(l,NRlm) 

R  m=l 

where 


N. 


1  ^  IX 

fty(l,NRlm)  =  I  V-Nxlm)- 


R  m=l 


(4.1) 


(4.2) 
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4.2  Simulation  Results 


In  this  section,  we  validate  eq(3.21)  using  computer  generated  random 
processes.  Specifically,  a  scaler  autoregressive  process  of  order  one  AR(1)  with  a 
K-distributed  white  noise  drivmg  term  was  used  to  synthesize  the  data  time  series. 
The  correlation  function  for  this  process  is  exponential  and  can  be  expressed  in 
terms  of  the  one-lag  temporal  correlation  parameter  X  such  that  [2] 

Ry(k)  =  ay(X)'^'exp|j0(k)]  (4.3) 

where  Oy  is  the  variance  of  the  observation  data  process  y(n)  and  X  is  the  one-lag 

temporal  correlation  parameter  such  that  ()<X<1.  In  the  special  case  of  the  AR(1) 

process  used  here,  Gy  =4,  0(k)=O  and  X^-a(l)  where  a(l)  is  the  AR(1)  coefficient. 

Computed  results  were  obtained  using  Monte-Carlo  simulation  with  10,000 
realizations.  A  plot  of  VyfKNj)  versus  the  shape  parameter  a  is  shown  in  Figure  1 

for  lag  values  1=0,1  and  Nj=100.  These  curves  reveal  that  for  a<5  (i.e.,  for  non- 
Gaussian  SIRP's  with  high  tails),  Vy(l,N^)  increases  dramatically  as  a  decreases. 

In  Figure  2,  analytic  values  of  Vy(l,NT)  are  plotted  versus  the  time  sample 
window  size,  N^,  with  a  as  a  parameter.  These  curves  show  the  effect  of  the 
second  term  on  the  right  hand  side  of  eq(3.21)  which  is  independent  of  Nj.  These 
results  show  that  the  estimator  lacks  consistency;  i.e.,  Vy(l,Nj)  does  not  decrease 
with  increasing  N^.  This  results  from  the  non-ergodic  property  of  the  SIRP's. 

Finally,  in  Figure  3,  analytic  and  computed  values  of  Vy(l,NT)  versus  the 

one-lag  temporal  correlation  parameter  X  are  shown  for  lag  values  1=0,1.  The 
AR(1)  process  had  a  shape  parameter  of  a=0.3  in  this  case.  We  observe  that 

Vy(l,Nj)  for  =0  is  relatively  insensitive  to  changes  in  the  temporal  correlation  of 

the  processes.  Again  the  second  term  on  the  RHS  of  eq(3.21)  accounts  for  this 
effect.  We  also  point  out  that  at  lag  1=0,  the  correlation  function  estimator  is 

estimating  the  variance  of  the  process.  Thus,  the  high  tails  for  this  process  affect 
the  estimate  of  the  variance.  For  lag  values  other  than  zero,  however,  Vy(l,Ny)  is 

highly  dependent  on  the  temporal  correlation.  This  result  can  also  be  explained  by 
the  second  term  in  eq(3.21)  which  decreases  with  decreasing  temporal  correlation 
for  lag  values  other  than  zero. 
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VARIANCE  OF 
CORRELATION  ESTIMATOR 


0  2  4  6  8  101214161820 


a 

Figure  1  Analytic  and  computed  Vy(l,Ni-)  versus  the  shape  parameter  a  for  lag 
values  I  =  0, 1  for  an  AR(1)  K-distributed  process  with  Oy  =  4,  N^^IOO. 
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VARIANCE  OF 
CORRELATION  FUNCTION 


TIME  SAMPLE  WINDOW  SIZE 


-  0^.1 

- - -  0=0.5 

.  0^2.0 

. . .  0=10.0 

Gaussian 


Figure  2  Analytic  values  of  Vy(l,Nj)  versus  the  time  sample  window  size  for 

2 

an  AR(1)  K-distributed  process  with  Oy  =  4  and  the  shape  parameter  a  as 
a  parameter. 
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VARIANCE  OF 
CORRELATION  FUNCTION 


Figure  3  Analytic  and  computed  Vy(l,N-r)  versus  the  one-lag  temporal  correlation 

parameter  X  for  lag  values  1=0  and  1  using  an  AR(1)  K-distributed  process 

2 

with  shape  parameter  a  =  0.3,  Cy  =  4,  Nj=100. 


5.0  CONCLUSIONS 


In  this  paper,  general  analytic  expressions  have  been  derived  for  the 
variance,  the  error  variance  and  the  bias  of  the  time-averaged  correlation  function 
estimator  when  observing  non-Gaussian  spherically  invariant  random  processes 
(SIRP’s).  These  expressions  were  validated  for  the  special  case  of  a  K-distibuted 
AR(1)  process  via  a  Monte-Carlo  computer  simulation.  Furthermore,  these 
analytic  functions  were  expressed  in  terms  of  the  process  variance,  the  temporal 
correlation,  the  data  window  sizes  used  to  average  the  estimates,  and  the  shaping 
parameter  of  the  K-distibuted  process.  Finally,  they  were  shown  to  reduce  to  the 
expressions  for  Gaussian  processes  as  a  special  case. 
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APPENDIX  A  DERIVATION  OF  EQ(3.3) 


In  this  appendix,  we  derive  the  expression  for  the  variance  of  fey(l,N) 

expressed  by  eq(3.3).  Consider  the  biased,  time-averaged  estimate  of  the 
autocorrelation  function  [6];  ie.. 


r 


n=0 

1 

if  Zyi(")yi(''-iio 

^  n=0 


0<I<N^-1 


-(N^-1)<I<0. 


(A.1) 


where  the  symbol  a  in  this  discussion  designates  the  quantity  as  an  estimate.  Let 

<(>(n,l)  =  yi(n)y*(n  - 1).  (A.2) 

Assuming  stationarity,  the  covariance  of  (l)(n,l)  can  be  expressed  as 

C^(k,l)  =  E[  {<Kn,l)-E(<|)(n.l)] }  { (|)*(n-k,l)  -  E[<|)*(n-k,l)] )  ] 

=  E[<|)(n,l)<t)*(n-k,l)]  -  E((|i(n,l)]E(<|)*(n-kJ)] 

-  E[(|)(n,l)]E[(|)*(n-k,l)l  +  E[(|i(n,l))E[(|)*(n-k,l)] 

=  R^(k,l)  -  E[(|)(n,l)]E[<>*(n-k,l)] 

where 

R^(k,l)  =  E[i|)(n,l)(|)*(n  -  k,l)].  (A.4) 

Assuming  stationarity,  we  have  from  eq(A.2), 

E[(|)(n,l)]  =  Ry(l)  (A.5a) 


(A.3a) 

(A.3b) 

(A.3c) 
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(A.5b) 


E[({>*(n-kJ)]  =  R,(l) 


so  that 


C^(kJ)  =  I^(k,l)  -  lRy(l)P  (A.6a) 

=  E[yj(n)y*(n  -  l)yi  (n  -  k)yj(n  - 1  -  k)]  -  lRy(l)P.  (A.6b) 

Now  consider  the  variance  of  the  complex  time  averaged  estimate  (l,N) 


which  can  be  expressed  as 


Vj,(I,Nt)  =  e{  [fty(l,NT)-E[ftj,(l,NT)]][fty(l,NT)-E[ft'(l,NT)]]} 

=  E[6,(I.NT)ftJ(l,NT)]  -  E[fty(l,NT)]E[ftJ(I.NT)]. 


(A.7a) 

(A.7b) 


Using  eq(A.l)  for  positive  and  negative  I,  we  have 

fty(I.NT)fty(I.NT)  = 
r  Nt-I-Nx-I-I 

X  X  yi(«)y«Vi)y*(p)yi(p-i)  o^UNj-i 
Nt  n=0  p=0 


;;3  X  X  yi*(n)yi(n-iii)yi(p)y,*(p-iJi)  -(Ny  -i )<  i  <  o 

n=0  p=0 


(A.8) 


so  that 


E[  fty(l,NT)fty(l,NT)  ]= 

"  Nx-l-lNx-1-1 

X  X  E[yi(n)yr(n-l)y-(p)yi(p-l)] 

I  Nt  n=0  p=0 

Nx-  l-Nx-ll|-l 

;-2  X  X  E[y*(n)yi(n-IIi)yi(p)y*(p-lll)] 
kNx  n=0  p=0 


0<l<Nx-l 


-(Ni.-l)<l<0. 


(A.9) 


Also, 
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E[fej,(l  JJt)]  = 


(A.  10a) 


Nt-I-1 

(;f  I  Ryd)  0<I<Nt-1 

^  n=0 
Nt-iii-i 

I  Ry(l)  -(Nt-1)<I<0. 

^  n=0 

Expanding  eq(A.lOa),  we  have 

f  Ry(l)-^Ry(l)  0<ISNr-l 

E[fey(l  J1t)1  /  (A.lOb) 

[Ry(l)-iRy(l)  -(Nr-l)Sl<0. 

We  note  that  the  second  term  on  the  right  hand  side  of  eq(A.lOb)  denotes  the  bias 
of  the  estimate.  Thus,  the  magnitude  of  the  bias  is  expressed  as  IBI=  III  IRy(l)l/Nj. 

From  eq(A.lOa),  we  have 
E[fty(l,NT)]E[fe^(l,NT)]  = 

Nt-I-1Nt-I-1 

-2  S  E  lRy(l)P  0  <  I  <  Nt 
Nt  n=0  p=0 

-2  I  I  lRy(l)|2  -(NrD^I^O. 

Nt  n=0  p=0 

Using  eqs(A.9)  and  (A.  11)  in  eq(A.7b),  we  obtain 
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Vy(WT)  = 

Nx-l-N-pl-l  ^ 

I  S  {E[yi(n)y,Vl)y'(p)yi(p-l)]-lR  (l)|2) 
Nt  n=0  p=0 

for  0<l<Nr-l 

;3  X  X  {E[yi(n)yi(n-lll)y,(p)y;(p-lll)]-lR  (l)P) 

Nj  n=0  p=0 

for  -(Nt-1)<I<0. 

Using  eq(A.6b)  in  (A.  12) 

3  S  I  C^(n-pJ)  0<I<Nt-1 

Nt  n=0  p=0 
Nt-III-INt-III-I 

;:;2  I  I  c;„(n  -  p,lll)  -(Nr-l)<l<0. 

Nt  n=0  p=0 

We  now  let  k  =  n  -  p  where 


-(Nt-I-  l)<k<NT-l- 1 

for 

0<I<Nt-1 

-(Nt-III-  l)<k<NT-ill- 1 

for 

-(Nt-1)<I<0. 

(A.  12) 


(A.13) 

(A.14a) 

(A.14b) 


We  also  note  that  eq(A.14b)  is  equivalent  to  eq(A.14a)  for  negative  values  of  I  so 
that 
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Vy(l,NT)  = 


^  X  [NT.-lll-lkl]C^(k,l) 

NTk=-(NT-ll|-l) 

Nx-ll|-l 

-T  X  [Nt  -  III  -  Ikl]  C;>*(k.lll) 

lNTk=-(NT-ll|-l) 


However,  for  negative  lag  I,  we  have 

Cj^(k.lll)  =  C^(k,l)  (A.16) 

so  that  after  dividing  the  bracketed  factor  by  one  of  the  Nj-  terms  in  the 
denominator 


0<l<Nx-l 


-(Nt-1)<I<0. 


(A.15) 


1 


Nt- 


•1 


Vy(l,NT)=jr  I  1- 


I  +  Ikl] 

Nt  J 


C^(k,l) 


(A.17) 


for  both  positive  and  negative  values  of  I.  In  Appendix  G  of  [3],  we  show  that  the 
imaginary  terms  in  C^(k,l)  cancel  when  summed  over  positive  and  negative  values 

of  k  so  that 


N  2;  1 

’■k=-(NTll|-l)‘- 


(A.18) 
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APPENDIX  B  DERIVATION  OF  EQ(3.9) 


In  this  appendix,  we  derive  eq(3.9).  Consider  the  quantity 

=  E[xi(n)X|  (n  -  l)xj  (n  -  k)xj(n  - 1  -  k)].  (B.l) 

In  the  special  case  where  the  process  xjCn)  is  complex  Gaussian,  then  [10] 

=  E[xi(n)xi  (n  -  l)]E[xi  (n  -  k)xi(n  - 1  -  k)] 

+  E[xj(n)xi  (n  -  k)]E[xi  (n  -  l)xj(n  - 1  -  k)].  (B.2) 

where  use  has  been  made  of  the  fact  that  E[)q(n)xj(k)]=0  for  n^k.  However,  we  do 

not  wish  to  constrain  this  discussion  to  this  restrictive  case.  Rather,  we  wish  to 
consider  the  more  general  case  of  a  Gaussian  process  Xj(n)  with  unconstrained 

quadrature  components.  We  therefore  consider 


Xi(n)  =  Xii(n)  +  j  XiQ(n)  (B.3) 

where  the  processes  x^jCn)  and  XiQ(n)  are  jointly  Gaussian.  Using  eq(B.3)  in  (B.l), 
we  obtain 

Rx^(k,l)  =  E{[Xii(n)  +  j  XiQ(n)][Xii(n-l)  -  j  XiQ(n-l)] 

.  [Xji(n-k)  -  j  XiQ(n-k)] [xii(n-l-k)  +  j  XiQ(n-l-k)] }  (B.4a) 

=  E  {  [xii(n)Xji(n-l)+XjQ(n)XiQ(n-l)+jXjQ(n)Xji(n-l)-jXii(n)XiQ(n-l)] 

.  [xii(n-k)xii(n-l-k)+XiQ(n-k)xiQ(n-l-k) 

+jxji(n-k)xjQ(n-l-k)  -  jXjQ(n-k)Xji(n-l-k)]  }  (B.4b) 
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=  E[Xji(n)Xii(n-l)Xii(n-k)Xii(n-l-k)]  +  E[XjQ(n)XjQ(n-l)Xji(n-k)xii(n-l-k)] 

+  E[xy(n)xQ(n-l)XiQ(n-k)XiQ(n-l-k)]  +  E[XiQ(n)XiQ(n-l)xiQ(n-k)XiQ(n-l-k)] 

-  E[XiQ(n)Xii(n-l)Xii(n-k)XjQ(n-l-k)]  +  E[Xii(n)XiQ(n-l)Xji(n-k)xiQ(n-l-k)] 

+  E[XiQ(n)xii(n-l)XiQ(n-k)Xji(n-l-k)]  -  E[Xii(n)XjQ(n-l)xjQ(n-k)xii(n-l-k)] 
+jE[Xii(n)Xii(n-l)Xii(n-k)xiQ(n-l-k)]  -  jE[Xii(n)Xii(n-l)xiQ(n-k)Xii(n-l-k)] 
+jE[XiQ(n)XiQ(n-l)Xii(n-k)XiQ(n-l-k)]  -  jE[XjQ(n)XiQ(n-l)xjQ(n-k)Xii(n-l-k)] 
+jE[XiQ(n)Xii(n-l)Xji(n-k)Xii(n-l-k)]+jE[XjQ(n)Xii(n-I)xiQ(n-k)XjQ(n-l-k)] 
-jE[Xii(n)XiQ(n-l)Xij(n-k)Xii(n-l-k)]  -  j  E[Xii(n)XiQ(n-l)XiQ(n-k)XjQ(n-l-k)] 

(B.4c) 

For  Gaussian,  zero-mean  quadrature  components,  eq(F.4c)  can  be  expressed 

R_  (k,l)  =  (r“(I)]2  +  (R"(k)]2  +  rP(I  +  k)R"(k  - 1) 
w 

+  R!r(l)RH(l)  +  [Ru  (k)]^  +  R^'d  +  k)R|?'(k  -  I) 

+  Ru(I)r1?^(I)  +  [rJV)]2  +  R?5(|  +  k)R?P(k  - 1) 

+  (Ru^(l)]^  +  [R^(k)]^  +  Ra^d  +  k)R^(k  - 1) 

-  R|?‘d)R!P(l)  -  RP'(k)RiP(k)  -  Rp^d  +  k)R,"(k  - 1) 

+  [r!P(I)1^  +  Ri?(k)RP(k)  +  RjPd  +  k)Rp'(k  - 1) 

+  (Rp'd)l^  +  R.?V)R!?(k)  +  Rp^d  +  k)RjP(k  - 1) 

-  RjPd)Rp\l)  -  RjP(k)RP'(k)  -  R^d  +  k)Rp^(k  - 1) 

+j  {RuCDRiPd)  +  RaWIPoc)  +  RjPd  +  k)RP(k  - 1)) 

-j  { Ra(l)Rp'd)  +  R!P(k)Radc)  +  Rad  +  k)R!P(k  - 1) ) 

+j  {Ra^CDRjPd)  +  Rp'(k)RP^(k)  +  Rp^d  +  k)Rp'(k  -  D) 

-j  {  RP^d)Rp'd)  +  Rp^(k)RpV)  +  Rp'd  +  k)Rp^(k  - 1) } 

+j  {Rp'd)R.“d)  +  Rp‘(k)Ru(k)  +  RP’d  +  k)Ri-(k  -  D) 

+j  {Rp'd)Ra^(I)  +  RP^(k)R!P(k)  +  Rp^d  +  k)RS^(k  -  D) 

-j  { R’Pd)R‘i  (I)  +  Ra  (k)Rp^(k)  +  R^d  +  k)Rp'(k  - 1) } 

-j  {R?Pd)Rp^d)  +  R!P(k)RP^(k)  +  RjPd  +  k)Rp%  - 1)} 

(B.5) 
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where  we  note  that  the  first  two  terms  in  each  parenthesis  for  the  imaginary  terms 
cancel.  Since 


R(l)  -  [Ra\l)  +  R^(l)l  +  j  [Rh'(I)  -  Ru'^d)] 

then 


(B.6) 


|R(I)I^  =  [r“(I)1^  +  2Ru(l)R^(l)  +  [R^I)]2 

+  [Rh'(I)1^  -  2r!?'(I)r!P(I)  +  [RP^d)]^  (B.7) 

and  similarly  for  lR(k)P  so  that 

R  (lc,l)=  iRjid)!^  +  iRiidc)!^  +  FiidJt)  (B.8) 

w 

where 

Fud Jt)  =  { R-ld  +  k)  -  R|fd  +  k) }  { Rud  -  k)  -  rS^I  -  k) } 

+  { R^'d + k) + RiPd + k) )  { R§'d .  k) + R-Pd  -  k) ) 

-  j  {Rud  +  k)  -  rSS(|  +  k)  )  {  rS'(I  .  k)  +  RlPd  .  k) } 

+  j  {  R-ld  -  k)  -  Rf^d  -  k) )  {  RS'd  +  k)  +  RjPd  +  k) ) .  (B.9) 
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APPENDIX  C  DERIVATION  OF  THE  EXPRESSION  FOR  E[s^l 


In  '  Appendix,  an  analytic  expression  for  E[s^]  is  derived  in  terms  of  the 
shape  and  acale  parameters  of  fg(s)  where  f^Cs)  is  a  Gamma  distribution  and  the 

random  variable  s  is  real  and  non-negative.  In  this  case,  the  observation  data 
vector  process  yj  =  sijj^  described  in  eq(2.1)  has  a  K-distribution.  The  author  is 

indebted  to  Muralidhar  Rangaswamy  for  suggestinging  the  following  derivation. 
For  the  Ganuna  distributed  f5(s)  with  non-negative  s, 

OO 

E[s4]  =  J  (bs)2a-ls4  exp(-b2s2)ds  (C.la) 

OO 

^  J  (b)2«-ls2a+3  exp(-b2s2)ds.  (C. lb) 

Consider  s=s’/b,  so  that 


Now  let  s'=V^  so  that 

lp*W 

fw(w)=  . 

Using  s=s'/b  and  s'=V^ 

E[s4]  =  E[(s')4]/b^  =  E[w2]/b4. 


However, 


E[w2]  =  J 


^^a+lg-w 


r(a) 


dv,' 


Using  (C.5b)  in  (C.4) 


E[s4]  =  E[w2]/b4  =  ^^ 


(C.2) 


(C.3) 


(C.4) 


(C.5a) 

(C.5b) 


(C.6) 
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programs  in  areas  including,  but  not  limited  to, 
communications,  command  and  control,  battle  management, 
intelligence  information  processing,  computational 
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